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This paper proposes a method to extend the 
current ISO Guide to the Expression of 
Uncertainty in Measurement to include 
the case of known, but uncorrected, 
measurement bias. It is strongly recom- 
mended that measurement results be 
corrected for bias, however in some situa- 
tions this may not be practical, hence an 
extension of the Guide is proposed to 
address this special situation. The 
method keeps with the spirit of the Guide 
in maintaining the link between uncer- 
tainty and statistical confidence. Similarly, 
the method maintains the transferability 
of one uncertainty statement to be included 



as a component in another uncertainty 
analysis. The procedure involves modifying 
the calculation of the expanded uncer- 
tainty, allowing it to become asymmetric 
about the measurement value. The 
method is compared to other alternative 
procedures, and an illustration of how it 
affects tolerance zones is presented. 
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1. Introduction 



Recently, the ISO Guide to the Expression of Uncer- 
tainty in Measurement (the Guide) [1], and the associ- 
ated NIST adaptation [2], have described a unified 
convention for expressing measurement uncertainty. 
Application of the Guide has extended beyond calibra- 
tion and research laboratories and into the industrial 
domain of manufactured products. At the factory floor 
level the recommended (and strongly preferred) practice 
of correcting for all known bias effects may not be 
economically possible due to such factors as limited 
instrumentation, operator training, and the large 
throughput of measurements. Since the Guide does not 
deal directly with the situation where a known measure- 
ment bias is present but is uncorrected, we propose a 
simple convention to extend the Guides procedures to 
address this special case. Uncorrected measurement 



bias may arise in situations where applying a correction 
for a known measurement bias would be costly, but 
increasing the measurement uncertainty to allow for the 
uncorrected bias would still result in an acceptable 
uncertainty statement. Initially, it might seem paradoxi- 
cal to be aware of a measurement bias but fail to correct 
for it; however, such situations are rather common. For 
example, the user of an automated instrument may know 
a bias occurs under certain measurement situations, and 
be unable to modify the behavior of the instrument. 
Since "paper and pencil" corrections to each measure- 
ment value can be time consuming and error prone, 
particularly under high measurement throughput 
situations, it may be more economically reasonable to 
simply account for this bias by enlarging the uncertainty 
value that is attached to every measurement result. 
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A few examples of measurements that include uncor- 
rected bias are now presented to illustrate the situation. 
A manufacturer of a precision positional indicator may 
know that all the indicators produced read approxi- 
mately 0.5 % too high, with only a small variation of 
0.1 % (standard deviation) between indicators. This is 
within the required 1 % relative uncertainty specifica- 
tion for the indicators and satisfies the customer's needs. 
It may be expensive and difficult to adjust the manufac- 
turing process to reduce the 0.5 % bias, or even to apply 
a 0.5 % correction to each unit; consequently, it is easier 
to subsume this bias into the uncertainty statement. 
Another example may be an automated instrument that 
is sensitive to some slowly varying parameter such as 
temperature, atmospheric pressure, humidity, etc. The 
instrument may lack a sensor to input this parameter and 
the user may be "locked out" of the software which 
records the measurement results; hence an automated 
correction cannot be performed to account for this 
systematic bias. However, the user may be able to 
specify the upper and lower acceptance limits, i.e., the 
conformance zone, for the measurement; see Fig. 1. If 
this bias is sufficiently small, it may be economically 
sensible to subsume it into the uncertainty statement. 
Doing so will alter the expanded uncertainty, and hence 
modify the conformance zone. 
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Fig. 1. The functional specification of a part and the corresponding 
inspection zones; U is the expanded uncertainty of the measurement. 
Parts are accepted if the measurement result is within the confor- 
mance zone. 



consistent with the Guide, have included the bias as an 
ordinary uncertainty source which is added in the usual 
root-sum-of-squares (RSS) manner. This has the unde- 
sirable effect of incorrectly stating the expanded uncer- 
tainty, because the bias is added in an RSS manner and 
is multiplied by the coverage factor. 1 Hence, the rela- 
tionship between measurement confidence and the ex- 
panded uncertainty is broken, as illustrated in detail 
later. Since many parts are accepted or rejected on the 
basis that the measurement results demonstrate confor- 
mance with the part specification [3] (see Fig. 1), it is 
important not to misstate the uncertainty (or confi- 
dence) associated with the measurement. 

This document describes a convention to account 
explicitly for uncorrected measurement bias in an uncer- 
tainty statement. We believe any method to include 
measurement bias in the uncertainty statement should 
have the following desirable properties. 

1 . The final quoted uncertainty must be greater than 
or equal to the uncertainty that would be quoted 
if the bias was corrected. Underestimating the 
uncertainty indicates an invalid uncertainty 
statement. Similarly, excessively overestimating 
the uncertainty indicates a poorly constructed 
uncertainty statement. 

2. The method must reduce to the method given by 
the Guide when the bias correction is applied. 

3. For any coverage factor and any magnitude of 
bias, the level of confidence for the expanded 
uncertainty should be at least the level obtained 
for the case of corrected bias, e.g., if the distri- 
bution of the values that could reasonably be 
assigned to the measurand is Gaussian, then 
k = 2 should imply at least 95 % confidence. 

4. The method should be transferable so that both 
the uncertainty and the bias from one result can 
be used as components in another uncertainty 
statement. 

5. The method should be simple and inexpensive to 
implement. 



The Guide primarily addresses the situation in which 
all known biases have been corrected, which is the 
recommended practice. However, Appendix F of the 
Guide does briefly discuss the situation of uncorrected 
measurement bias. It is our intention to extend this 
procedure and to provide examples of its implementa- 
tion. Our motivation for this effort includes the observa- 
tion that some industrial practitioners, in an effort to be 



An inaccurate method for calculating an expanded uncertainty can 
lead to the uncertainty being either overstated or understated, depend- 
ing on the values of the bias, combined standard uncertainty, the 
coverage factor, and the shape of the distribution. When the uncer- 
tainty is overstated (i.e., is too large), the nominal confidence level 
claimed will be smaller than it should be to properly describe the given 
uncertainty. Conversely, if the uncertainty is understated (i.e., is too 
small), the nominal confidence level claimed will be larger than it 
should be. 
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2. Recommendations for Measurements 
Involving Uncorrected Bias 

As described in the Guide, measurement results 
should be corrected for bias, and the uncertainty in the 
bias correction should be included as a contribution to 
the combined standard uncertainty. However, when 
correcting for the measurement bias is not practical, it 
still should be accounted for explicitly in the uncertainty 
statement. In our proposed approach, a complete uncer- 
tainty statement includes the combined standard uncer- 
tainty (computed as if the measurement result was to be 
corrected for the bias), an explicit statement of the 
(signed) bias value, and an expanded uncertainty which 
includes the effect of the bias term. 

The usual method of using the expanded uncer- 
tainty U, for a measurement result y which has an 
unknown ("true") value of the measurand F, is to 
produce an uncertainty interval (with the level of confi- 
dence determined by the coverage factor) given by: 
y-U^Y<y+U. Consequently, the measurement 
result is often stated as: y ± U. 

In the case where the result is corrected for a bias 8, 
a similar uncertainty interval can be constructed for the 
corrected measurement result j cor = (y - S) given by: 
Jcor - t/ — ^ — Jcor + U. This is equivalent to the un- 
certainty interval of: y - (U + 8) < Y < y + (U - 8). 
Consequently, the measurement result could be stated 
+ (U-8) 

This can lead to the unfortunate possibility that one of 
the uncertainty limits may become negative, e.g., if the 
bias is positive and 8 > U then the upper uncertainty 
limit will be negative. This may confuse practitioners, 
particularly when constructing diagrams such as Fig. 1; 
consequently, we propose the additional requirement 
that the uncertainty limits be greater than or equal to 
zero for all values of 8, which always maintains non- 
negative uncertainty limits at a cost of a somewhat 
wider uncertainty interval. 

Hence , for a measurement result y which includes an 
uncorrected bias 8, the value of the measurand Y is 
estimated by the following uncertainty interval where U 
is the usual expanded uncertainty that would be calcu- 
lated if the measurement had been corrected for bias; 
see Fig. 2. An uncertainty interval in the presence of 
uncorrected bias is given by: 

y-U.<Y<y+U + 
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Fig. 2. Uncorrected measurement result y t having bias 5 (5>0), 
shown with expanded uncertainties U+ (black) and £/_ (dark 
gray) (top). The corresponding corrected measurement result y cor > is 
also shown together with the usual expanded uncertainty U (light 
gray) (bottom). The same situation with 5 < 0. 
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Note that a large bias may result in a one sided 
uncertainty interval, e.g., if 8 > U then U- = U + 8 and 
U+ = 0. (One could propose a symmetric uncertainty 
interval, with the expanded uncertainty given by the 
larger of U+ or LL, but this further reduces the confor- 
mance zone with no additional economic benefit.) 

When computing an uncertainty statement for cases 
where there are several sources of uncorrected bias, 
biases are algebraically added together (explicitly 
accounting for the sign of the bias). The resulting net 
bias is stated together with the combined standard uncer- 
tainty. Occasionally, the case may arise where multiple 
sources of uncertainty have bias and these biases are not 
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independent. To avoid "double counting" the bias 
sources, the degree of overlap of the biases is estimated 
and this amount is subtracted from the bias summation. 
The uncertainty in the overlap correction is added in a 
RSS manner to the combined standard uncertainty. 
Finally, we point out that the expanded uncertainty must 
be re-computed if the coverage factor is changed, and in 
particular, that U± (k = 2) ^ 2 X U± (k = 1). 

The proposed approach is recommended for its 
simplicity and utilitarian value (see Fig. 3), even though 
it can somewhat overestimate the uncertainty. However, 
for a given coverage factor the corresponding level of 
confidence will be at least as high as would be the case 
if the bias had been corrected. 



and simply sums it in an RSS manner with the usual 
combined standard uncertainty; we denote this method 
as RSSw c . The second method sums the bias in a RSS 
manner with the usual expanded uncertainty; we denote 
this as RSS U. In contrast our proposed method 
algebraically sums the signed bias with the expanded 
uncertainty (unless the bias is large), so we denote our 
method as SUMt/. The three methods are shown below. 



RSSw c Method: Y = y± U RSSUc 

where Usss™ = k Ju 2 + 8 2 
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Fig. 3. An example of the functional specification of a part and the 
corresponding inspection zones for a measurement result with uncor- 
rected bias; U+ and i/_ are the expanded uncertainties which include 
the effects of measurement bias (top: bias > 0, bottom: bias < 0). 
Parts are accepted if the measurement result is within the confor- 
mance zone. 



3. Comparison With Other Methods of 
Combining Uncorrected Bias 

We compare our proposed method of treating uncor- 
rected bias with two other procedures which have been 
proposed to address this problem. The first procedure 
treats the uncorrected bias as another uncertainty source 



RSSC/ Method: Y = y± U RSS u 

where U RSS u = ^lk 2 ul + 8 2 



SUMU Method: Y = 
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Figure 4 illustrates some important differences 
between the three methods. The three plots display the 
actual statistical confidence of the three methods versus 
the magnitude of the uncorrected bias for coverage 
factors of k= 1, 2, and 3. Gaussian (normal) distribu- 
tions are assumed in all cases. For example, in the k = 2 
case, ideally we would like to maintain a 95 % (strictly 
speaking, 95.44 %) confidence for all values of the 
uncorrected bias. Our proposed method (SUMLO main- 
tains this confidence until the ratio of the bias to the 
combined standard uncertainty becomes larger than the 
coverage factor. For such large bias values, the SUMt/ 
method produces uncertainty intervals that are slightly 
conservative (larger than necessary to produce valid 
95 % confidence levels.) The RSSw c method, on the 
other hand, can produce uncertainties that are consider- 
ably larger than necessary. For example, with k = 2 and 
a bias twice as large as the combined standard uncer- 
tainty (8/u c = 2), the actual achieved confidence level 
of the interval is nearly 100 %, rather than the nominal 
95 % (see Fig. 4.) Although this overstatement of the 
uncertainty is not necessarily disastrous, it can come at 
the significant cost of consuming most of the part toler- 
ance zone, i.e., specification zone, as we will soon 
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Fig. 4. Comparison of the actual achieved confidence levels resulting 
from three methods of incorporating uncorrected bias in uncertainty 
intervals. The methods are the proposed SUMf/ method (solid line), 
the RSSm c method (dotted line) and the RSSf/ method (dashed line). 
(In the case k = 1, RSSw c = RSSt/.) 




describe. In contrast, the RSSU method seriously under- 
states the true uncertainty. For example, with a coverage 
factor of k = 2 and an uncorrected bias twice as large 
as the combined standard uncertainty (5/w c = 2), the 
uncertainty interval is under-sized to the extent that the 
actual achieved confidence is less than 80 %, which falls 
significantly short of the nominal 95 % confidence 
level. 

The three plots in Fig. 5 display the relative sizes of 
the expanded uncertainty interval for each of the three 
methods as a function of the magnitude of the uncor- 
rected bias, for the coverage factors k = 1,2, and 3. The 
scale of the ordinate on the left hand side of the plots is 
defined as the full width of the uncertainty interval 
divided by the combined standard uncertainty, and 
hence the ratio would be equal to 2 £ (where k is the 
coverage factor) if the bias had been corrected. As seen 
in the figure, the SUMt/ method consistently produces 
the smallest expanded uncertainty interval of any of the 
methods for all values of bias and coverage factors. 

An example of how the size of the expanded uncer- 
tainty interval might impact the user is shown on the 
right hand ordinate. This axis describes the percentage 
of the specification zone that is consumed by the 
expanded uncertainty interval for the somewhat typical 
case where the ratio of the specification zone to 
expanded uncertainty interval zone (if the bias had been 
corrected) is 4:1. (Obviously, the right hand ordinate 
axis is numerically correct only for the particular exam- 
ple of a gauging ratio of 4:1; other ratios, while having 
qualitatively similar behavior, would have different 
percentages of the specification zone consumed by the 
expanded uncertainty interval.) The plot illustrates 
that the SUMt/ method consumes the smallest percent- 
age of the specification zone compared to the other 
two methods. For example, in the k = 2 case, and for an 
uncorrected bias equal to four times the combined 
standard uncertainty (8/u c = 4), the SUMt/ method 
would consume 37.5 % of the specification zone 
(compared to 25 % if the bias had been corrected), 
while the RSSt/ and RSSw c methods consume 56 % and 
over 100 %, respectively. 

Figures 4 and 5 illustrate that, of the three methods 
described, our proposed method (SUML0 offers a 
significant advantage in reducing the impact on the user 
of the uncorrected bias when subsumed into the uncer- 
tainty statement. This method always maintains an 
actual level of confidence equal to or greater than the 
nominal confidence corresponding to the coverage 
factor in use. While our examples are based on the 
Gaussian distribution, the SUMt/ method retains this 
relationship (between k and the confidence level) for 
any distribution shape because the resulting interval 
always contains at least the same interval as would be 
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Fig. 5. Comparison of uncertainty interval lengths for three methods 
of incorporating uncorrected bias in uncertainty intervals. The 
methods are the proposed SUM£7 method (solid line), the RSSh c 
method (dotted line) and the RSSt/ method (dashed line). The scale 
on the right-hand axis of the plots assumes that the value of the 
expanded uncertainty represents a gauging ratio of 4:1 in the case of 
zero bias (5 = 0). (In the case k = 1, RSS« C = RSSU.) 



covered by the corrected result. Furthermore, of the 
three methods discussed, the SUMt/ method minimizes 
the percentage of the specification zone consumed by 
the expanded uncertainty interval. In addition, the 
method avoids negative expanded uncertainties, which 
could be confusing to the user when determining the 
conformance zone (as shown in Fig. 3). 



4. Examples of Uncertainty Statements 
Containing Uncorrected Bias 

The following examples should clarify the procedure 
for expressing measurement uncertainty in the presence 
of uncorrected bias. We use the same terminology as the 
Guide when referring to the evaluation of the bias, i.e., 
Type A corresponds to any valid statistical method for 
treating the data and Type B corresponds to a bias 
evaluated by other means. For each example we give a 
worked numerical case to illustrate the procedure; in 
these examples all expanded uncertainties are evaluated 
with a coverage factor of k=2. These examples are 
contrived to illustrate the procedure of accounting for 
uncorrected bias and are not designed to describe the 
subtleties of creating an uncertainty statement; con- 
sequently many uncertainty sources may have been 
omitted or simplified. 



4.1 Example 1: One Type A bias 

Consider a measurement result y , having a constant 
bias of estimated magnitude 8^. Assume that 8^ is 
assessed directly by repeated measurements of a refer- 
ence standard having a combined standard uncertainty 
of w ref . Specifically, suppose 8i is evaluated as the 
average deviation from the reference standard's 
calibrated value found from N\ measurements. Let the 
experimental standard deviation of the N\ measure- 
ments be s ; the standard uncertainty of the estimated 
bias is then s/N\ /2 . The combined standard uncertainty 
of the measurement result is given below, where u\ 
accounts for the combination of all other uncertainty 
sources not directly associated with the bias. Note that 
Ui already includes the repeatability of the measure- 
ment, i.e., the standard deviation s, since this source of 
uncertainty is always present and is unaffected by the 
fixed bias. The combined standard uncertainty is the 
same quantity that would be determined if the measure- 
ment had been corrected for the bias. Note that the 
expanded uncertainty is treated asymmetrically and the 
results depend on the sign of the bias. In this example 
8 { < and ku c + 8 { > 0. 
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Bias = 8\ 

U+ = ku c - 8[ 

U- = ku c + 8\ 



The uncertainty interval is given by y -U-^Y<y+U+. 
Equivalently the result can be stated with the expanded 

\+U + 
U. ' 



uncertainty as y 



Numerical case: Suppose that a measuring machine 
designed to inspect parts of length 100 mm is checked 
with a reference standard having a combined standard 
uncertainty of w ref = 1.5 |uun. A total of 15 measure- 
ments are recorded having an experimental standard 
deviation of 3.0 |am with the mean result 4.0 |am 
smaller than the calibrated value of the reference 
standard, i.e., the bias is negative. From previous work 
it is known that all other uncertainty sources combined 
yield a standard uncertainty of 5.0 |am, i.e., 
U\ =5.0 |uun. Therefore: 

w c =(5.0 2 + ^-+ 1.5 2 jVm = 5.3|uim, 

Bias = -4.0 |uun 

U+ = 2u c - (-4.0) |uun = 14.6 |uun 

U- = 2u c + (-4.0) |uun = 6.6 |uun, 

and the measurement result y can be stated with the 

f+ 14.6 |uun 



expanded uncertainty as: y 



- 6.6 |uun 



4.2 Example 2: One Type B bias 

For some measurements, the bias might be estimated 
rather than directly measured. For example, length 
measurements made on the factory floor often are not 
corrected back to the standard temperature of 20 °C. 
Hence, the uncorrected thermal expansion represents a 
measurement bias. Suppose the factory floor tempera- 
ture varies between 20 °C and 30 °C, about an estimated 
mean of 25 °C. The estimated magnitude of the bias is 
given by 8 2 (8 2 > 0) which accounts for the length 
deviation due to the 5 °C mean uncorrected thermal 
expansion. The variability of the temperature can be 
described by a uniform distribution of full width 10 °C, 
i.e., by a standard uncertainty of 2.9 °C which, when 
multiplied by the appropriate coefficient of thermal 



expansion, gives rise to the corresponding standard 
uncertainty u temv . The combined standard uncertainty 
and expanded uncertainty are given below, where u 2 
would be the combined standard uncertainty for the 
measurement if the measurement had been corrected 
back to 20 °C. (The value of u 2 includes the uncertain- 
ties in the temperature measurements, the uncertainties 
in the thermal expansion coefficient, and other effects.) 
In this example 8 2 > and ku c - 8 2 > 0. 



/ V 

[2 2 1 2 

U c — \U 2 + Mtemp I 



Bias = 8 2 



U+ = ku c -8 2 



U- = ku c +8 2 



The uncertainty interval is given by y -U-^Y<y+U+. 
Equivalently the result can be stated with the expanded 



uncertainty as y 



\-u. ■ 



Numerical case: Suppose a measuring machine that 
inspects parts of length 100 mm has u 2 = 7.0 |uun, and 
the machine's scale has a thermal expansion coefficient 
of 9 (|mm/m)/ C, and the part under inspection has a 
thermal expansion coefficient of 22 (|uun/m)/ C. Then 
the differential thermal expansion is 22 (|uun/m)/ C 
- 9 (|uun/m)/ C = 13 (|uun/m)/ C, corresponding to an 
average bias of 13(|am/m)/°CX5 °CX 0.100 m= 
6.5|am. The standard uncertainty associated with the 
variation in the temperature (modeled as a uniform 
distribution) is given by Wte mp = 13 (|uun/m)/ C 
X 0.100 m X 2.9 °C= 3.8 |uun. Therefore: 

u c =( 7.0 2 + 3.8 2 J Vm = 8.0 |uun, 
Bias =+6.5 |uun 
U+ = 2u c - 6.5 |uun = 9.4 |uun 
U- = 2u c + 6.5 |uun = 22.4 |uun, 
and the measurement result y can be stated with the 

expanded uncertainty as: y\ ' 



4.3 



4 |am 



Example 3: Combination of independent 
biases 



An uncertainty statement consists of two uncertainty 
sources given by those of examples 1 and 2, which are 
assumed to be independent. The resulting uncertainty 
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statement is given below. Note that 6 3 is the sum of the 
two biases, and that we assume 6 3 > and ku c -8 3 > 0; 
M c i and u c2 are the combined standard uncertainties from 
examples 1 and 2, respectively. 



U c \ + U C 2 f 



Bias =63 = 61 + 62 

U+ = ku c - 83 
U- = ku c + 63 . 



The uncertainty interval is given by y-U-^Y<y+U+. 
Equivalently the result can be stated with the expanded 

f+tf + 



uncertainty as y 



U. 



Numerical case: Using the values given in examples 
1 and 2 we find 



w c =( 5.3 2 + 8.0 2 JVm = 9.6 urn, 
Bias = +2.5|uun 
U+ = 2u c - 2.5 |am = 16.7 jim 
*7_ = 2w c + 2.5 |uun = 21.7|uun, 



and the measurement result y can be stated with the 
expanded uncertainty as: jm 917 



4.4 Example 4: Combination of independent and 
dependent biases 

The measuring instrument described by the uncer- 
tainty statement of Example 3 is modified by an acces- 
sory that does not add variability but produces an addi- 
tional bias 8. This bias is assessed by repeated 
measurements, i.e., found from N 4 measurements of a 
second (independent) reference standard (having a com- 
bined standard uncertainty of w^). The measurements 
collectively have an experimental standard deviation s 
(this is the same standard deviation found in example 1), 
and a mean value differing from the calibrated value by 
6, with 8 < and 8 < 8 { < 0. It is estimated that between 
30 % to 50 % of the bias estimated by 8 is already 
accounted for in 8 { . To avoid double counting, 0.4 6 
(which is the best estimate of the overlap, i.e., the aver- 



age of 30 % and 50 % = 40 % = 0.4) is subtracted 
from the bias summation. A standard uncertainty of 
0. 1 6 / v3 , corresponding to a uniform distribution 
(from 0.3 6 to 0.5 6 with half width 0.1 6), accounting 
for the uncertainty of the bias overlap is added in an 
RSS manner to the other standard uncertainties. We 
assume the total net bias 6 4 > and ku c - 6 4 > 0, as 
shown below. 



_( 2 2 2 s 1 (0-15) 2 \i 

U c — I Mel + M c2 + ^ref2 + AT + n J 

Bias = 64 = Si + 6 2 +6 - 0.46 = 61 + 6 2 + 0.66 

U+ = ku c - 84 
U- = ku c + 64 . 

The uncertainty interval is given by y-U-^Y<y+U+. 
Equivalently the result can be stated with the expanded 

f + U + 
-U- ' 



uncertainty as y < 



Numerical case: The additional bias 6 = -2.0 fim is 
evaluated as the mean of 10 measurements using a refer- 
ence standard with combined standard uncertainty 
w re f2 = 10 fim. Using the values given in the previous 
examples, we find 

Wc =(5.3 2 + 8.0 2 + 1.0 2 + ^ + ^ ) Vm=9.7 fim, 

Bias = + 1.3 |am 

U+ = 2u c - 1 .3 |am =18.1 |am 

U- = 2u c + 1 .3 |am = 20.7 jim, 
and the measurement result y can be stated with the 
expanded uncertainty as: y \ ' ^ 
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